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The visual system is a truly amazing thing. It must, as 
1s true of anything having to do with living organisms, be 
fully  describable both anatomically and functionally in 
terms of well defined physical principles. This is certainly 
true at present of the optical end of the visual systen, 
from the cornea to the retina. There is very little mystery 
E Te refraction , reflection, and diffraction of light in 
the structures of the eyeball. But there is stili a great 
deal of mystery associated with the nervous system end of 
the visual system, even though much hard, reproducible 


Scientific data exists. 


These data tend to be of four general types. In 
aninals, data consists largely of microelectrode studies of 
cellular electrical activity in response to various visual 
or electrical stimuli. In humans it is generally perceptual 
in nature , the subject being presented with various visual 
stimuli at or near the threshold of detection and being 
asked for a verbal response upon detecting tne stimulus. One 
exception is the electroencephalogram, recorded using scalp 
electrodes as the subject is presented with various stimuli. 
Of course, there are the all-important histological studies 
of botn human and animal nervous tissue, whose ain, in 
general, is to ascertain functional anatomical features, 
such as interconnections between neurons. All four of these 
data types are of great value ir aiming toward a solution of 
how visual systems work. But what has been conspicuously 
missing until recently are suggestions and speculaticns as 
to what circuits of neural elements could be responsible for 


visual phencmena. It is the aim of this thesis to review 
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what 1S Known about the neurophysiology of visual systems, 
and then tc propose some models of neurons and neural 
circuits which could explain some of the observed perceptual 
phenomena. It must be restated for emphasis that the results 
of the modeling in this thesis, although based upon the best 
information available, are necessarily highly speculative, 
and should be considered as how certain phenomena might 
occur rather than how they do occur. 
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The process we call vision begins when photons from a 
Scene enter the cornea and ends when the visual association 
area of the brain conveys meaning to the organisn. اا‎ IS 
obvious that a vast amount of information processing occurs 
in order for this transition to occur. Much information 
which enters the cornea is lost to the organism, but this is 
an adaptive advantage rather than a disadvantage. The 
organism must respond guickly to the important features of 
the visual field. If all incident information were required 
to be processed and presented to the nervous system cf the 
organism, the response could not be as rapid. It is 
apparent, therefore, that visual systens nust have means for 
extracting the important aspects of a scene. The aspects 
which are considered important vary from species to species, 
but two things tend to be extracted by the visual systems of 


all organisms studied: high contrast features and movement. 


A. THE NEURCN AND THE SYNAPSE 


Before discussing the processing of information by the 
visual system, the basic functional units of which all 


nervous tissue is built will be described. 


The neuron, or nerve cell, consists of a cell body 
(soma) , an input end (dendrites), and an output end (axon), 
as shown in Fig 1. The point at which two nerve cells 
communicate is called a synapse. Consider a nerve impulse 


(action potential) proceeding to the right at point A. Upon 
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reaching tke dendrites of neuron 1, the propagating action 
potential causes some submicroscopic change which causes the 
neurotransmitter vessicles to dump their contents into the 
synaptic cleft. Mitochondria are present in the bouton to 
provide the energy necessary for this release. After 
diffusing across the cleft, the neurotransmitter causes ion 
permeability changes in the subsynaptic memkrane which in 


turn cause membrane potential changes. 


The membrane would have a resting potential of  -80 
Millivolts (inside negative with respect to the outside). 
The effect of an excitatory neurotransmitter would be to 


depolarize the membrane. 


By a process called electrotonic spread, the potential 
change at the dendrites is transmitted by ion currents to 
the axon hillock. If the membrane potential at the axon 
hillock reaches roughly -60 millivolts, a dramatic change in 
membrane permeability to ions causes a propagating polarity 
reversal (the action potential), which travels the length of 


the axon cf neuron four. 


If cther E-inputs are occurring, Say at neuron two, 
Spatial summation would occur. This means that inputs at 
different dendritic locations will each cause a change at 
tne axon hillock, and can work together, or sum, to produce 


an action potential. 


If a time sequence of E-inputs occurs at one dendrite, 
temporal summation occurs. This means that inputs at 
different times can work together, or sum, to produce an 
action potential, so long as the inputs are not too far 
apart in tine. Figure 1 shows a typical post synaptic 
response (PSR), which is the change in membrane potential at 
the axon hillock due to a single input at a dendrite. The 


finite duration of the PSR means that inputs occurring in 
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rapid succession will not each have to start anew from rest 
petential, but will have some potential change left over 


from previous inputs. 


Inhibitory as well as excitatory neurons exist. If a 
neuron is inhibitory, it releases a neurotransmitter which 
causes postsynaptic hyperpolarization vice depolarization. 
That is, it tends to inhibit downstream neurons from 
producing outputs. The shape of the inhibitory PSR is an 
inverted version of the excitatory PSR, and Summation at tne 
axon hillock is a subtraction. A neuron is either wholly 


excitatory or wholly inhibitory--never mixed. 


B. THE VISUAL PATHWAYS 


Figure 2 depicts the visual processing pathways. Light 
enters the eyes and is focused on the ma by the cornea 
and lens structures. AS quanta of light are absorbed, the 
retinal receptors respond by varying membrane potentials. 
These varying potentials are coupled through the cells of 
the retina to the ganglion cells, whose fibers form the 
optic nerve. The ganglion cells code the visual scene into 
spike action potentials for transmission to the prain. The 
information leaving the retina has been processed ty the 
retinal neural circuits, and therefore is not simply a coded 


version of the scene. 


At the optic chiasm, fibers undergo a rerouting such 
that all information coming from the right half of the 
visual scene goes to the left half of the brain, while 
information ccming from the left half of the visual scene 


goes to tbe right half of the brain. 


At the lateral geniculate nuclei, the fibers synapse 
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with other neurons. The neural interconnections in the 
lateral geniculate nuclei process the visual scene even 
more. It is believed that the interleaving of information in 
the lateral geniculate nuclei from the same scene portion 
but from different eyes constitutes processing which 


ultimately results in depth perception. 


Fibers frcm the neurons of the lateral geniculate nuclei 
terminate cn neurons of the visual cortex. Here, the 
processing has proceeded to the đegree that specific visual 
features at specific locations are being extracted. These 
specific features of the visual scene are pieced together in 
the visual association areas, and ultimately result in the 
Organism's being able to interact with his visual 


environment. 


Not shown is the pons of the brain, located in the brain 
stem. The fons also receives visual information and is an 


important center for processing this information. 


C. THE TARGET NEURON CONCEPT 


The presence of a particular feature is nearly always 
Signalled by strong spike outputs from a Single neuron. This 
neuron is usually retinal (a ganglion cell), geniculate, 
cortical, or pontine, and is termed a target neuron in this 
thesis, since much information is targeted at or converged 
to the neuron. The output tends to be binary in 
nature--either the condition is met, in which case frequent 
outputs cccur, or the condition is not met, in which case 
few or no outputs occur. In general, the sinplest sets of 
criteria for cutput production occur early in the visual 
pathway, while very complicated sets of criteria generally 


apply later. 
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An example of a simple criterion is common for 
ganglion and geniculate cells. Termed the "on-center" cells, 
strong outputs occur when receptors feeding them are 
illuminated by a small dot of light. The dual of this 
EBLuatron occurs for the "off-center" cells--the small dot 
of light causes the ganglion cell to have no outputs, 


whereas in tctal darkness, the cell would have outputs. 


In addition to Simply turning on or off in response 
to a small dct of light, ganglion cells respond oppositely 
to bright surround stimuli. That is, when an annulus of 
light illuminates receptors surrounding the receptors which 
feed a ganglion cell of the on-center type, the result is an 
off response. Similarly, a surround stimulus Tor an 
off-center ganglion cell produces an on response. The cause 
of the surround stimulus effects has been shown to be 
inhibitory interneurons (horizontal and amacrine cells) 


which spread their inhibition laterally. 


D Geniculate 


= a SS መኡ፡- መ መሙ: <=ፎ=:=- 


Geniculate cells remain fairly simple in their 
properties. They are very similar to ganglion cells, but 
have an enhanced ability for surround stimuli to counteract 
center stimuli. Thus they appear to represent a hicher 
degree of capability for extracting information concerning 


contrast. 
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Examples of more involved sets of criteria occur 
cortically, where "simple" as well as "complex" cells have 
been established (Ref 10]. Simple cells respond most 
favorably to line stimuli which have the correct position in 
the visual field and the correct angular orientation. 
Complex cells respond strongly for line stimuli with proper 
orientation and direction of movement, and tend tc have 
larger "on" fields. Complex cells are believed to be targets 
for outputs of many simple cells which detect the sane 
orientation. In some way (possibly unilateral spread of 
inhibition) the neural interconnections mediate the motion 
direction specificity of the complex cells. Thus the simple 
and complex cortical cells present signals tc the 
associaticn areas, each signal having its cwn meaning in 
terms of the content of the visual field. Signals from many 
Millions cf these cells interconnect with many millions of 
association cells to provide the organism with a conscious 


perception of the scene. 


The pons of the brain is also an important target 
area for visual information. It is believed that the pons 
is important in assembling visual information fron the 
visual cortex and relaying this information to the 
cerebellum for use in motor control [Ref 3). A typical 
pontine cell responds strongly to motion in one direction 
only and is cnly weakly stimulated or even inhibited by 
motion in the opposite direction. Small stimuli are most 
effective in producing strong outputs; shape and orientation 
are not generally important. An individual target cell would 
respond mcst strongly to motion at one particular angular 
velocity. The total range of angular velocities covered by 
all cells recorded was roughly ten to 800 degrees per second 
[Ref 8). 
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۱ لد‎ REIINA 


Because the response of retinal ganglion cells is not a 
Simple function of photons falling on connected receptors, 
lt is apparent that retinal processing does indeed gc on. 
The retina 1S important enough to deserve a description 
here, however brief and oversimplified, because it contains 
two systems of laterally inhibiting interneurons. Lateral 
inhibiticn is very fundamental to the functioning 55 


systen. 


heen retina 1S pictured in Fig 3 1n cross section. Light 
illuminates the receptor cells after passing through the 
eyeball and the other neural layers. Photon absorptions 
cause changes in visual pigment substances which in turn 
Cause variations in the membrane potential of the receptor 
cells, Recent evidence indicates that this mezbrane 
potential variation is coupled to the bipolar and horizontal 
cells by modulating the flow of an unidentified chemical 
neurotransmitter substance. The bipolar and horizontal cells 
are very small in length as compared with normal "long-axon" 
neurons, and therefore do not need to employ spikes to 
transmit information along tneir length. The information is 
in the form cf subthreshold membrane potential changes (slow 
potentials) which travel electrotonically and aodulate the 
release of a neurctransmitter just as did receptor potential 
Variations. Bipolar cells terminate on amacrine and ganglion 
cells (in primates). Amacrine cells are larger, depolarize 
when stimulated (receptors, horizontal, and bipolar cells 
hyperpolarize), and tend to have a propensity for spike 
production. Horizontal and amacrine cells are inhibitory, 
while the other retinal cells are excitatory. The axons of 


ganglion cells form the optic nerve, in which all 
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17۳۲ 9۳ 1۵۳ 1S in the form of action potentials. Because no 
other connection exists between the retina and the train, 
these action potentials constitute the total result of 


retinal processing of the visual scene. 


Several important points need to be made atout the 
neural interccnnections just discussed. Each ganglion cell 
has associated with it a receptive field. Foveally, there 
are few receptors feeding each ganglicn cell. These 
receptors are exclusively cones, and fairly high levels of 
light are required for vision. Peripherally, as many as a 
hundred receptors, mostly rods, feed each ganglion cell, 
thus enhancing sensitivity at the expense of acuity. The 
most important point, however, is that the information 
leaving a certain ganglion cell depends not merely upcn the 
brightness falling upon the receptors feeding it, but also 
depends upon what light distribution fails upon adjacent 
areas. The hcrizontal and amacrine cells perform this 
function by extending laterally, and by inhibiting the 
neurons upon which they terminate. This explains the term 
“lateral inhibition," and also explains why ganglion cells 


respond oppcesitely to bright surround stimuli. 


Another important type of processing which occurs 
retinally is the development of combined colcr signals. Each 
of three types of cone cells has its own response spectrua, 
With significant overlap. Ultimately, the Signais from the 
three receptor types must be compared to give the organisa 
the proper color sensation. There is evidence that this 
comparison begins retinally by the formation of difference 
Signals at the ganglion cell level. Although color visual 
processing will not be modeled in this thesis, this was 
mentioned tc point out that other types of processing do go 
on retinally. Additionally, this is another example cf how 
visual processing occurs in stages, with early develcpment 


occurring retinally, and final features being extracted 
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cortically. 


Thus the retina is capable of coding the visual scene 
into action potentials which go to the brain. The coding is 
the result of the total spatial distribution of light on the 
retina--not merely on each local point of light taken 
independently. This lays the ground work for modeling of 


Spatial phenomena later in this thesis. 


The resrcnse of a ganglion cell can reflect tezporal 
properties as well as spatial distributions of light. In the 
mudpuppy (a small fish), microelectrode measurements have 
confirmed that one type of ganglion cell responds to 
stationary light distributions while a different type of 
ganglion cell responds only to changes in Tigar 
۳ 1 1۲ ۱1 ۰10۵3 5. This means that retinal processing has 
occurred which has extracted motion information from the 
visual field. In the frog, there are five types of ganglion 
cells, one of which is very specific for a small, convex, 
dark object (such as a fly) moving through the receptive 
field of that cell. This represents a very high degree of 
motion detection capability located right in the frog's 
retina. In other vertebrates, similar target cells exist, 
but at higher centers such as the pons, the superior 


062111211115, and the visual cortex. 


The zcint of discussing retinal motion detectors is to 
point out that since the "equipment" and types of neural 
interconnections available retinally are very well known, 
the number of ways in which this system can work are 
limited. A lateral inhibition network can be used to model 
a motion detector. Furthermore, the presence of such a 
retinal motion detecting system in the frog lends credence 


to any such 46 
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SPATIAL CONSIDERATIONS‏ .كس 


A neural network with lateral inhibition can sharpen 
details in a visual scene. The entry of light intc the 
optical end of the eyeball is accompanied by scattering and 
diffraction, both of which tend to create a blurred image on 
the retina cf an object which should be perceived as having 
sharp contrasts. The end result of this process is that 
cortical ceils responsible for detecting a sharp line, edge, 
or slit at a certain angular orientation at a certain point 
in the visual field can do so more efficiently. This process 


will be explained more fully later, as models are presented. 


A useful concept in dealing with visual scenes is 
Spatial frequency. This term refers to the frequency, in 
cycles per degree of visual angle, at which luminosity 
varies from light to dark. The simplest case is a level of 
luminosity which does not change with position (zero cycles 
per degree). The next most fundamental example is a field 
where there is no variation vertically, but horizontally the 
luminosity varies from light to dark as the sine of 
position. This is called a sinusoidal grating. Ànother 
example is a series of vertical light and dark bars, the 
so-called square wave grating. Just as with any periodic 
time series waveform, these periodic spatial gratings can be 
considered as beinc the sum of all Fourier components, each 


component being a pure sine at some harmonic of the 
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fundamental frequency. 


3. Ihe Spatial Modulation Transfer Function 


ፍወ A ee = اس‎ | = መፁጮሙ መይ ዴዴ መሙ A መመመ “መሎ e መመ = بت‎  -። 


The visual system responds differently to different 
Spatial frequencies. In perceptual studies, the subject is 
asked to signal when he just detects a sinusoidal grating 
flashed on a screen. Each grating flashed has two basic 
properties: spatial frequency and contrast. Contrast refers 
to the difference in luminosity between the lightest and 
darkest regions. When the data is plotted, it is found that 
roughly three cycles per degree is the spatial frequency at 
which subjects can detect gratings with the lowest contrast. 
AS spatial frequency gets higher or lower than three cycles 
per degree, mcre contrast is required for detection. The 
resulting curve of Spatial frequency versus contrast 
threshold for detection is called the spatial modulation 
transfer function. It is considered as the best estimate of 


the spatial frequency response of the human visual systen. 


The high frequency fall-off ان‎ the Spatial 
modulaticn transfer function is due in part to the optical 
properties cf the cornea, lens, and humor of the eye. Any 
lens system haS an upper limit to its resolution, and 
transfer functions have long been used to describe the high 
Spatial frequency performance of lens systems. The finite 
size of the individual receptors, the scattering of light as 
it impinges upon the retina, and the summation from 
receptors to bipolar cells are all believed to play roles in 


limiting the high frequency response. 


The low frequency fall-off is much harder to 
comprehend, and involves a comparison of the visual angle 
Subtended by one cycle of pattern with the visual angle 


aroun which inhibition from a pinpoint of light would 
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spread. When inhibition spreads through one-half cycle, 
outputs frcaæ ganglion cells are at enhanced contrast levels. 
This is because strong inhibition from the bright area 
inhibits the dark area, while lack of inhibition from the 
dark area allows maximum output from the bright area, thus 
enhancing contrast. It is important to note here that since 
080098 00 does not begin until several neurons are 
traversed radially, the centers of the bright peaks dc not 
inhibit the edges of the bright regions. Next, consider a 
Situation in which the lateral extent of inhibitory spread 
1s much less than one cycle of pattern. The result here 
would be that bright areas inhibit themselves while dark 
areas receive little inhibition from themselves. The effect 


would be a lcss of contrast. 
The low response at low frequencies as well as the 


contrast enhancing response at high frequencies will be 


modeled in this thesis. 
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1۳19 THE MODELS 


AO TAE COMPUTER FACILITY 


The computer modeling for this thesis was all performed 
using the PDP-11/40 digital computer, made by Digital 
Equipment Corporation of Maynard, Mass., and located in the 
Bicengineering Laboratory at the Naval Postgraduate School. 
This computer is equipped with 32K words (1K=1024, cne word 
equals 16 bits) of readily addressable core memory, two 
RK-11 disk drives, a TC-11 magnetic tape drive pair, and an 
LA-30 keyboard/character printer. Block data is displayed 
on a storage cathode ray tube and plotted by a Hewlett 
Packard 70048 621 recorder. 


All neural modeling programs in existence when inherited 
by the author were written in Time Series Language (TSL) 
witn links to machine language routines where necessary. 
TSL is a higher level language especially designed for 
Manipulating blocks of data. There are advantages as well as 
disadvantages to uSing a higher level language in géneral 
and TSL specifically. On the positive side, programs are 
easy to change, as moving of statements 35 done 
automatically. Also, the programmer need know nothing about 
the processor and memory utilization in order to perforn 
certain limited programs. But in order to extract the 
fullest performance from the 32K words of core, speed 
program execution somewhat, know exactly where in core 
Stacks and blocks are located, and generally know what is 


happenins, there iS no substitute for complete machine 
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language 2 7 69 72 0 1 1 0 ۰ Loris eng, DE. Marmont has 
painstakingly developed the APTEC "language," which is a 
collecticn cf frequently used data processing and servicing 
routines. All neural modeling programs used in tais thesis 


use APTEC and pure machine language. 


B. THE BASIC NEURON MODEL 


The cbject of the basic excitatory and inhibitory 
postsynaptic potential (EIPSP) program is tc form the froper 
PSP response given a scenario of excitatory and inhikitory 
inputs at a neuron's dendrites (Fig 4a). The accomplishnent 
of this rather modest sounding task took considerable time, 
talent, and guidance, and was accomplished by the students 
feet. aMarmont during 1975 as work for his course in 
computer modeling. The operation of the EIPSP program will 
be reviewed here, since it forms the basis upon which later 


more elaborate modeling programs were built. 


First, the properly shaped responses for excitatory as 
well as inhibitory inputs are formed in a pair of 1K blocks. 
These are termed the excitatory and inhibitory postsynaptic 
responses (EPSR and IPSR) and are shown in Fig 10. Then a 1K 
PSP processing block is establisted along with a pointing 
register for use in forming the PSP at each word of the 
1106٩٤ Misco needed are excitatory and inhibitory input 
counting registers, and two stacks for keeping track of the 
proper age or each input which has occurred since the last 


Output. 


Processing begins by testing for the presence of an 
excitatory input at the first word of the block (Fig 5). If 
an input 1S present, a zero age marker is placed on the 


E-age stack, and the E-counter is incremented. The E-ccunter 
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is then tested to determine whether any inputs requiring PSP 
update have occurred since the last output. If the counter 
is positive a nifty maneuver forming the heart of 21858 is 
accomplished. Using the E-input counter as a loop ccunter 
and the £-age stack as the source of ages for each E-input 
which has cccurred since the last output, the PSP werd is 
formed by adding together the proper number of properly aged 
EPSR's. The E-age stack is then aged by one word to prepare 


it for the next processing pass. 


This identical procedure is followed for  I-inputs, 
except that the aged IPSR's are subtracted instead of added 
when forming the PSP word. 


Next the resultant PSP word is compared with the 
threshold EOL spike 17007213۴16 If below threshold, 
processing proceeds to the next word of the block. If equal 
to or greater than threshold, a marker is placed in the 
output block, the E and I-age stacks are reset, the E and 
I-input counters are zeroed, and the processing block 
pointer is advanced to the end of the refractory period. A 
test 1S then made to determine whether or not the pointer is 
at the end of the processing block. If so, processing ends 
and the results are displayed. If not, the pointer is 
advanced to the next word of the block and the entire 


Sequence repeated. 


No effort was made to model the membrane action 
potential which exists during output. Rather, no processing 
whatever is done during this time, leaving the PSP equal to 
Zero. (The PSP processing block was set to zero prior to 
beginning prccessing). The action potential, if modeled, 
would be strictly cosmetic, since no use would be made of 


the membrane potential excursion which would occur. 


This basic neural model is extremely useful in building 
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functional neural circuits. This is done in its simplest 
form by stcring the 1K output marker block on disk and 
employing that aS an excitatory or inhibitory input to 
Subsequent neurons, thus modeling divergence. Similariy, 
more than one output block can be added together and applied 
as the E or I-input to a subsequent neuron cr neurons, thus 
modeling convergence. In its most complex form, the eight 
basic neurons are combined into a Simultaneous, interactive 


lateral inhikiticn network, to be described later. 


C. THE TARGET NEURON 


NEUROE is the computer program which models the target 
neuron. Target neurons in visual processing are probarly in 
the retina, lateral geniculate nucleus, pons, or the visual 
cortex, and perform specific tasks, such as firing for one 
very specific visual stimulus. Neuron B (Fig 4b) represents 
a target neuron which fires when its E-inputs coincide with 
peaks ina sinusoidally oscillating PSP. Such a neuron must 
have tne cscillating PSP created in some way; in neuron B, 
«ከ 5 15 done by E and i-inputs provided by outputs from an 
oscillator, neuron A. There are reasons for postulating the 
existence of an element such aS neuron B. First, the 
frequency of oscillation of the PSP could be related in some 
way to the frequencies preferentially present in the 
electroencephalogram during some task [Rei 11). Second, 
sinusoidally varying PSP's have been observed in nature [Rei 
2]. In this thesis, the additional E-inputs come from the 
summed outputs of the eight channels or the lateral 
inhibition prcgram; neuron B has copious outputs when these 
additional E-inputs occur at the right frequency. This 
condition will correspond to a small target crossing the 


visual field at the preferred angular velocity. 
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BE THE NEURAL OSCILLATOR 


NEUOSC is the computer program which models a neuron 
(neuron A, Fig 4a) which generates regularly spaced groups 
of outputs. These outputs are then used to drive the ESP of 
target neuron B. NEUOSC is versatile in that it allows a 
choice of several ways of producing these regularly spaced 
output groupings. All methods are, of course, compatible 
with how neurons have been observed to function. Neuron A 
works by first being excited to threshold and producing 
mur pue: This is done by E~inputs at the dendrites, by self 
excitability, or by a combination of the two. The outputs 
are then fed back as inhibitory inputs after a specifyable 
time delay. By choosing the fright excitation level, 
inhibitory feedback delay, and inhibitory feedback strength, 
the neuron can be made to provide bunched output pulse 


trains where the bunches occur at any desired frequency. 


Self excitability has been observed in microelectrode 
Studies to be of either sawtooth or sinusoidal form [Ref 2]. 
All programs in this thesis utilize the sawtooth fora, which 
is generated in the program by forming a ramp in the PSP 
block. The ramp begins following a refractory period and 
ends when an output occurs. The slope of the raap is 
callable as a parameter. The outputs from neuron A are used 
as E-inputs to drive neuron B's PSP, while the inhititory 
feedback pulses of neuron A are used as the I-inputs to 


drive neuron B's PSP. 


The use of excitatory as well as inhibitory driving 
allows a much higher frequency in the PSP of neuron E. By 
using excitatory inputs alone to drive the PSP, the 


frequency at which a significant amplitude is attainatle is 


35 





limited ky the exponential fading of the postsynaptic 
response. By alternately driving with I-inputs, the sharp 
rise of tke inhibitory postsynaptic response curve is 
employed to guickly drive the PSP below rest potential, thus 


speeding up the oscillation. 


In addition to the normal modes of operation, neuron A 
is capable of accepting external I-inputs, and also of 
excitatory feedback, which might be of future use in 
modeling excessive neural discharge, such as might occur 


during epilepsy. 


E. ADAPTIVE NEURON 


PSPFAT is a computer program which nodels the behavior 
of a neuron whose parameters change with time, or adapts to 


inputs. 


The underlying purpose for modeling an adaptive neuron 
was to have a neural circuit element which would fire for 
only a brief burst following a step input of excitation. 
This would be roughly equivalent to a neural differentiator, 
although the pehavior when the step input is terminated is 
inconsistent with this analogy (the neuron does not go to a 
negative firing rate due to a negative rate of change of 
inputs). The adaptive neuron would serve as a means to 
separate change from steady state, and would have strong 
output only immediately following change. Such a neuron 
night be useful in a motion detecting network where a 


bright, mcving spot of light were involved. 
Neurons have been observed which have a certain low 


firing rate due to self-excitability under quiescent (no 


input) conditions [Ref 2]. When provided with an excitatory 
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Em ٠56۶7 1 ۳ rate 15 at first rapid, but then dies 
off to a level only slightly above the quiescent rate (Fig 
Cen the excitatory stimulus is terminated, firing 
returns to the quiescent rate. When an inhibitory stimulus 
is turned on, the firing rate goes to zero initially, but 
then returns to a rate slightly below the quiescent rate. 
Termination of the inhibitory stimulus causes the firing 


rate to return to guiescent. 


Before proceeding with PSPFAT, a good deal of thought 
was put into exactly what physical process is responsible 
for the phencmenon being modeled. When a neuron is referred 
to as less excitable, this normally means the membrane is 
hyperpolarized; being more excitable ncrmally refers tc the 
memtrane being depolarized. These conditions are fully 
modeled by the basic EIPSP neuron as PSP is continuously 
computed, and do not seem to be pertinent to modeling 
adaptation, fatigue, or facilitation. Adaptation is a rather 
nonspecific term meaning that the neuron's characteristics 
adapt to changing conditions. A change in spike threshold 
should not be entirely ruled out as a mechanism. A change in 
threshold would represent a Change in membrane 
characteristics, and the real answer to how the observed 
phenomena are caused probably does involve such a change. 
EU ME 1S nore likely that spike production, and not input 
history, would cause membrane changes at the axon hillock. 
There SEE no Simple way to envisicn the Spike 
production/threshold change scheme resulting in the behavior 


Or FIG 6a. 


Considerable work was done with a neuron model which 
changed its threshold in response to inputs. A history of 
E-inputs would raise the threshold, thus reducing the firing 
rowe 51021132192+ a history of T-inputs would lower the 
threshold. The object here was to make the inputs less 


potent as they became more numerous, a law of diminishing 


py 








returns cf sorts. That object was not really met by the 
method of changing the threshold. The model  prcduced 
plausible results for E-inputs, and less believable results 
1 مک وس‎ Because only a single parameter (spike 
threshold) changed in order to give the desired effect for 
both E and I-inputs histories, the algebraic difference (E 
Minus I) was decided upon to apply to threshold change. 
This is an unrealistic scheme, since no such E minus I input 
dependence or threshold is present in nature. The results 


۳ 15 model are not included in this thesis. 


A more likely scheme is that as inputs arrive at the 
presynaptic Site of neurotransmitter release in great 
numbers, the neurotransmitter is at first plentiful, but 
then is depleted, accounting for the loss of potency in the 
postsynaptic response. Alternately, depletion of the ATP 
supplies used by the synapse as energy for vessicle release 
would have the same effect. This would account for the 
behavior of Fig 6a, but would not explain facilitation, in 
which a synapse is "primed" by the arrival of a few inputs 
such that the postsynaptic response grows. It is probable 
that this behavior results from subsynaptic membrane changes 
rather than more neurotransmitter made available 
presynaptically, although the latter has not keen ruled out. 
Fatigue could also result from presynaptic inhibition, 
wherein outputs are feb back to presynaptic terminals as 
۱۱۱۱۱۱ 11 1 ۷ pulses, thus modulating the reiease of 
neurotransmitter. Evidence also exists that perhaps repeated 
Outputs cause buildup in the extra-cellular potassium ion 
concentration, and that this buildup modulates the release 


of neurotransmitter [Ref 16]. 


Fortunately, it is unnecessary to cnose one or the other 
when modeling, since only the postsynaptic response is of 
concern. PSPFAT, then, varies the potency of E and  i-inputs 


by varying the size of the postsynaptic response acccrding 


38 





to the running average of inputs. Thus the excitatory and 
inhibitory effects can be handled separately. As a mass of 5 
or I-inputs occurs, the size of the postsynaptic response 


decreases, thus modeling fatigue. 


In tne ESPFAT program, this task is handled by counting 
inputs over the specified time interval preceeding each word 
sS the 1K blcck. 


Since only integer arithmetic is used in neural nodeling 
{in order to maximize core usage), a small reduction in the 
postsynaptic response strength of say one-tenth had to be 
handled indirectly. This was done by first dividing both the 
E and I postsynaptic response blocks by 128, and then 
computing (on each pass) an integer for building them back 
up for ESP formation. These integer multipliers take into 
account the running averages and the factor by which the 
running averages affect the postsynaptic responses. 
Specifically, the integer for building the PSP blocks back 
oo as [128- (factor X running average) |]. If the factor is 
positive, the integer will be smaller than 128, and fatigue 
results. By selecting a negative factor, synaptic 


facilitation can be modeled. 


ሙ 


F. LATERAL INHIBITION 


The criginal lateral inhibition program is a highly 
complicated, intricate, and interactive composition, and is 
a great credit to LT. Dennis Marvel, who wrote it with 
suggestions from Dr. Marmont. When the author inherited it, 
however, ust had several shortcomings, whicn will be 


enumerated as they occur. 


11111 71 consists of eight 1X data blocks, each 
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representing a channel, or neuron, such as a retinal 
ganglion cell (Fig 7). LINHIB models any lateral inhibition 
network, however, and is not necessarily retinal. Inputs to 
the network are from upstream neurons (perhaps bipolar 
cells) which synapse on each of the eight ganglion celis. 
Outputs are sent via the optic nerve to the brain for 
further processing. Inhibition results whenever an  cutput 
occurs. An cutput from a neuron inhibits its neighbors, but 
never itself, and is mediated by amacrine and horizontal 


cells in the retina. 


The original version of LINHIB produced equal inhitition 
in all seven neurons each time an output occurred. This 
restraint was removed by the addition of program segments 
which compute the separation between the neuron producing 
the output and the neuron being inhibited, and then perforn 
a table lock-up to determine the appropriate inhikitory 
Strength. Termed the lateral inhibition decay (LID) takle, a 
typical entry would be 5432100. The first number describes 
the strength of inhibition of the neuron adjacent to where 
the output occurred, while the last number describes the 
strength cf inhibition of the neuron most remote from where 
the output cccurred. Therefore, this LID describes decay in 
relative inhibitory strength as distance from the cutput 
neuron increases. Later, as more flexibility was desired, a 
two Sided LID table was devised, allowing 1221121 02خ‎ ¥ 
influence to decay differently in different directions. A 
typical two-sided (but symmetrical) LID table might be 
001234505432100, with the central zero always present to 
indicate no self-inhibition. Thus LID=000000005432100 would 
produce a network in which inhibition occurred to one side 


Oma. y . 
Originally, all inhibition occurred after a rixed delay 


in time (cr really, words of the block). In order to add 


more flexibility, this was changed to allow a linear delay 
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Reno Sercad of inhibition. That is, if the neuron adjacent 
to the output is inhibited after 0.001 seconds, then the 
next would be inhibited after 0.002 seconds, the next after 
0.003 seconds, and so on (Fig 8). This linear delay could be 


accomplished through synaptic delays, as shcwn. 


The LINHIB program works in much the same way as the PSP 
production in the basic EIPSP model. That is, the 2255 and 
the IPSR are generated in a pair of 1K blocks which are aged 
and summed the proper number of times to form each PSP word. 
The biggest difference is in the way this is done. Because 
LINHIB models eight neurons vice a single neuron, much more 
memory is required. It would have been impossible to fit 
۳۴۳۲ ۲ 11۳۱۲ blocks, eight  I-input blocks, eight  cutput 
blocks, eight PSP blocks, and two PSR blocks ail into the 
core available. Therefore, the E-inputs, outputs, and 
I-inputs are all stored in compressed form. The E-input and 
Output blocks are each 256 word blocks containing the 
addresses of the markers. The I-inputs are stored ina 2K 
block where a given inhibitory unit consists of one word of 


address and cne word of relative strength. 


Processing begins by stepping through word number cne of 
each of the eight data blocks, and polling the compressed 
E-input block to find an address match, which, if found, 
signals an E-input at that location (Fig 9). Each time an 
E-input is found, a zero is placed on the E-age stack. The 
zero indicates that the PSR has not aged at all, since the 
fut has just occurred. Also, an E-input counter is 
incremented. Next, the PSP word is formed by adding the 
proper number of properly aged PSR's to the PSP block. when 
word number one of all eight data blocks is processed, a 
Similar procedure is followed for innibitory inputs. The 
difference tere is that the compressed I block is different 
in format; the I address is compared with the current 


processing address to detect a match. Then, the inhibitory 
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strength is used to increment the I address for more 
matching. Thus if the relative inhibitory strength is five, 
this would have the effect of producing five inhibitory 


pulses. 


Following the subtraction of the proper number of 
spoperly aged EPSR's from the PSPeword in each of the eight 
blocks, a ccmparison of PSP with spike threshold is made. If 
PSP equals or exceeds spixe threshold, the proper address is 
entered in the compressed output block, and the task of 
placing ھ7‎ OT) 1s begun (this has already been 
described). Finally, processing steps to the next word and 


returns to the top of the flow graph. 


After much work had been done with the  LINHIB program, 
the unsettling discovery was made that many of the results 
were probably invalid because of overflowing the capacity of 
the stack which is used to age the inhibitory inputs. As 
mentioned earlier, when graded inhibition was added to tne 
program, this was done by providing more markers for 
የ ርክ ርር inhibition, and fewer markers FOr weaker 
inhibition. The actual inhibitory effect was then set by 
adjusting the value of the IPSR. The end result of multiple 
markers was to fill and in some cases overflow the stack, 
thus invalidating many earlier runs. This prcblem was solved 
by enlarging the E and I-age factor stacks from 1K to 6K in 
Size. The extra core memory was gained by rewriting the 
entire program in the APTEC “"language.“ AiditioiWally, 
program steps were added which check the compressed E-input, 
Et and output blocks, and E/I-age stacks for overflow, 


and warn the operator of these undesirable conditions. 


Another pcint of concern which turned out to be entirely 
ርክ 5 invelved the placement of inhabiticn after the ramp 
delay was added. Because the eight processing blocks are 


continuous in core, an output near the end of one block will 
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produce inhibition at addresses which are beyond the end of 
the block intended, but which fall near the beginning of the 
following block. It turned out that these bogus I-pulses do 
not get taken as inputs for PSP computation, because by the 
time they get placed in the compressed I-block, processing 
is weil beyond their location. They do get displayed, 
however, but this problem is easily solved by graphical 


methods. 


መጠጠ uUNL IG ANT OUILIB 


The varicus 1K blocks of input pulse trains are built by 
a program called INLIB. The operator selects one of two 
versions of random generation, one of two versicns of 
constant frequency, or frequency modulation. These are 
stored on disk uncompressed for use with any program except 
LINHIB, which requires a 256 word compressed E-input [1 
The formaticn of this compressed block for LINHIB is by a 
program called OUTLIB, which reads any eight 1K blocks from 
disk and compresses them by storing marker addresses in the 
256 word block which is then stored on disk. The author 
rewrote these programs in APTEC, improved the frequency 
modulaticn program's flexibility, wrote one new program for 
generating constant frequency BLOCKS, made program 
modifications which increased the total number of inputs 
which could be placed in the 256 word block, and generated 


numerous additions to the existing library of inputs. 
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FIGURE 7 - LINHIB NETWORK, CONSTANT DELAY 
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FIGURE 8 - LINRIB NETWORK, RAMP DELAY 
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መመመ CONVENTICNS FOR PLOTTING OF DATA 


There are several clarifying points which will aid the 
reader in understanding the modeling plcts. 0 el 
٣۰٠۰ م۵۱0۵‎ inhibitory, or output spike markers appear which 
are or differing heights, this is of no account. The 
programs simply test for the presence of a non-zero marker, 
not caring about its magnitude. 2) Not all plots were made 
for every run for LINHIB, as this would require two or three 
full pages. Rather, only those plots needed to illustrate 
the discussicn are included. In general, the PSR's, the 
PSP's, the inputs, and the outputs are included. 3) The 
sizes of the IPSR and the EPSR relative to each other are 
accurate, but due to the consideration of making as much 
detail as possible in the space available, they will not 
always be scaled the same as the PSP plot. Scaling is, 
however, dcne after all computations are complete, and in no 
way affects the accuracy of the results. 4) The plots each 
cover a time course of 100 milliseconds. 5) The difference 
between threshcld and resting membrane potential is taken to 
be 20 millivclts. This can be gauged by noting that upon 
occurrence cf an output, the PSP trace drops vertically from 
threshold tc rest potential and remains there for at least 
the duration of the refractory period. All plots use 20 
millivolts as spike threshold. 6) Multiple markers in 
inhibitory plots are understood to be an indication of 
۲۳۳۳ ۲ 1۵ GE inhibition, and not actually multiple inhititor y 


action potentials. (7) All plots are the results of 
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computer calculations made with the modeling prcgrans 
described. The plots are therefore not merely how the author 
thinks things should happen, but how computer calculations 


indicate they should happen. 


B. TEMPORAL PHENOMENA 


It is impossible to really separate "spatial" from 
"temporal" when dealing with a spatial neural array 
processing a time sequence of events, but the distinction 
drawn here is just as the reader night expect:  tnose 
situations in which a change in time are predominantly 
important are covered under temporal, whereas if the change 
from neuron to neuron is most inportant, it as termed 


spatial. 


The first temporal phenomena to be modeled are 


igne and facilitation. 


Figure 10 shows a neuron, initially quiescent, 
receive a train of E-inputs. As the  E-input history 
increases, the PSR due to each E-input becomes smaller. This 
can be seen by observing the PSP trace carefully. At first 
each E-input produces a sizeable response. But as E-inputs 
accumulate, the PSR's become so small that they are tarely 
perceptable atop the quiescent ramp. As discussed earlier, 
this behavior probably results either from neurotransmitter 
depletion or subsynaptic membrane changes. Figure 11 shows 
fatigue in the case of I-inputs. The output trace clearly 
50 06۷9۷5 an initial extinction and a gradual return to firing 


at just below the quiescent rate. 
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By selecting a negative number for the fatigue 
۳ ۳ ال‎ ESPrAT, facilitation can be shown (Fig 12). 
Initially quiescent, the neuron is excited by the now 
familiar E-input train. As E-inputs accumulate, some 
submicrcscopic effect causes the PSR for each to wax in 
strength, resulting in an accelerating output. The 
facilitation modeled here is of very short duration, and 
should not ke confused with any long term changes which 
result from the plastic nature of synapses (Ref 7]. Such 
long term synaptic facilitation is a likely mechanism for 
long term memory. The very short duration facilitation of 
Fig 12 could conceivably be responsible for a person being 
able to glance at a table full of objects, look away, and 
picture the scene, enabling him to name the objects, whereas 


after several seconds, this is no longer fossible. 


One uncertainty in the fatigue models is that the 
real-life phenomenon might have resulted from receptor 
adaptation rather than from synaptic changes or subsynaptic 
membrane changes. The E or I-input train used in the models 
was, in mcst experimental measurements, actually a light dot 
Or surround stimulus rather than a known pulse train of 
constant frequency. Therefore, if a constant intensity light 
stimulus had resulted in receptor adaptation, the proper 
representation of inputs to the neuron would be a train of 
decreasing frequency. This alone could account for the 
decreasing output rate after the stimulus had been on for a 
Short time. The light and dark adaptation of receptor cells 
is a well kncwn phenomenon, but this occurs with a tine 
constant on the order of minutes, and could not result in 
changes on the order of one second or less. A review of 
individual receptor responses in the frog retina to light 
stimuli (Ref 15] indicates no discernable adaptation over a 
period cr cne second. This may not be true of all retinal 


receptors, hcwever. 
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Beine Neural Oscillator 
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The neural oscillator is used to generate bunched E 
and I-pulse trains for use with the target neuron. The 
character of these bunched pulse trains can be observed in 
Sue R and I-input picts of Fig 13b. 


One mcde of generating the required outputs consists 
cf allowing the oscillator neuron to have a quiescent firing 
rate, and then feeding back the outputs as inhibitory inputs 
(Fig 13a). By then using the output and feedback pulse 
trains as driving inputs to neuron B, the oscillatory PSP is 
created (Fig 13b). Alternately, the oscillator neuron can be 
provided with random E-inputs (Fig 14a). When outputs occur 


they are fed kack as I-inputs, as before. 


Although instability in the oscillator neuron is not 
of importance to other work in this thesis, a demonstration 
is included to show the versatility of the NEUOSC program 
(Fig 15). Note that originally, outputs result only írca the 
guiescent firing rate. Since the outputs are fed back as E 
vice I-infuts, the outputs wax in intensity at an ever 
increasing rate until the neuron fires at near the maximum 


allowed ky the refractory period. 


6 
ሥሥ 
Id 
ےا‎ 
IH 
0ا‎ 
ሠ 


ET T Neg larg 


The cutputs of the oscillator neuron are used to 
create a Sinusoidally varying PSP in the target neuron. The 
target neurcn would then fire most strongly in response to 
E-inputs at the proper phase and frequency. Conversely, if 
the E-inputs were of random character, the target neuron 


could produce a very regular output of known frequency and 
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phase. 


A gcod example of a higher frequency sinusoidal PSP 
is shown in Fig 16. Note the role of alternating E and 
Bee in driving the PSP in opposite directions. If an 
oscillating PSP were created using E-inputs alone, the slow 
decrease of the PSR would cause a gradual depolarization 
toward spike threshold, placing a severe upper limit or the 
frequencies and amplitudes attainable. The idea that higher 
frequencies may be used in CNS processing 1S being pursued 
in electrcencephalogram work by Dr. Marmont and his students 
in the 70-95 hertz range. It 15 probably an insult tc the 
CNS to believe it incapable of useful activity at 


frequencies above ten hertz [Ref 11]. 


Figure 17 is an example of regularization of random 
inputs. A basic constraint is that the PSP driving inputs 
should be much more numerous than the random inputs, cr tne 
latter will tend to dominate the PSP characteristics. 
Alternately, providing a weaker PSR for the random inputs 
would allcw the driving inputs to dominate the PSP, even 


though the random inputs might be very numerous. 


4. Motion Detection 


Moticn detection systems have been demonstrated by 
microelectrode studies in many species. These studies tend 
to indicate that motion detection is performed by neurons 
having very specific characteristics as to veloc yy, 
direction, and form for optimum detection. The adaptive 
advantage of an efficient system for motion detecticn is 
obvious: the objects in the visual field which are of 
greatest interest to an animal in the wild are those which 


are in Beticn. 
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a. Eand Pass 


The target neuron with oscillatory PSP can be 
put to practical use as a target velocity band pass gate. A 
tiny target crossing the LINHIB eight neuron array is 
represented Ly successive inputs at each neuron (Figs 18 and 
19). The outputs are applied to the target neuron, where 
the PSP is oscillating (Fig 20b). Here, only E-inputs fron 
the neural cscillator (Fig 20a) have been used to create the 
proper frequency. Because the inputs to neuron B frcm the 
LINHIB network are at the proper frequency and phase, strong 
outputs are produced from neuron B. This signal might say to 
the cortical centers for visual association that there is a 
target in the receptive field of neuron B which has X 
radians per second of angular velocity. The organism could 


then take action appropriate to the stimulus. 


Neuron B is a summing neuron, since all eight 
channels of LINHIB converge to excite neuron B. The Summing 
is performed only if the inputs occur at the proper points 
ön the PSP oscillation. 


The fact that phase as well as frequency must be 
correct in crder for the speed band pass gate neuron to pass 
the signal is a sticky point which has not been fully 
Solved. Perhaps the appearance of a target causes a strobing 
effect in the oscillating neuron which automatically adjusts 
the PSP oscillations to optimum phase. Alternately, perhaps 
a given frequency has four or more target neurons such that 
any phase of target would cause outputs from one or more 
target  neurcns. Creating multiple target neurons with 
oscillatcry PSP's of different phase is a simple natter of 
delaying the driving E and I-input pulse trains by a 


fraction of the oscillatory period, as shown in Fig 2b. 
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There is evidence that neurons do exist which 
are specific for speed of target notion [Refs 1 and 8],as 
well as for direction. Pontine cells respond to a band of 
speeds, whereas retinal speed specificity tends to be less 
discrete than a narrow band pass gate might provide. That 
is, in the retinal ganglion cells of the rabbit, response 
tended to ke broken down into two crude groups: high speed 


detectors and low speed detectors. 


Be Null versus Preferred Direction 


Directicn specificity is now modeled using the. 
lateral inhibition network. In Figs 18 and 19 the lateral 
inhibition retwork was used, but the parameters were 
adjusted so that the lateral nature of the network was 
Suppressed. In other words, neuron S has an early output, 
and produces inhibition in its neighbors. But this 
inhibition is no longer present (PSP has returned tc the 
resting value) in neuron T when E-inputs representing the 
Eget reach it. Obviously, 3f the duration of the PSR for 
I-inputs were longer, a moving target could be blanked out. 
Furthermore, if inhibition in one direction were much 
stronger than inhibition in another direction, target motion 
in one direction could be detected while target moticn in 
the other direction would be blanked out. Figures 21, 22, 
and 23 show the results of this modeling. Since the LID 
table is 000000005432100, the upward target is not inhibited 
at all, and each neuron produces an output. The downward 
target, however, produces only two outputs, in neurons 5 8 
X. When neurcn S fires, inhibition spreads downward and 
hyperpolarizes the membranes of the neurons below it. 
Because a long duration IPSR was used, outputs are prevented 
in the four neurons below neuron S. Neuron X is both later 


in time, and had weaker inhibition to begin with, so it 
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prcduces an output when excited. As with neuron S, the 
output from neuron X is effective in preventing outputs from 
neurons Y and Z. Thus upward is the so-called preferred 


direction, while downward is the null direction. 


The target neuron is once again a Summer. For 
all circuits except band pass, it is a simple summer, where 
one input is generally sufficient to produce an output. For 
band pass, frequency and phase of inputs must match 
frequency and phase of the oscillatory PSP in order for 


werent SUMZIng to occur. 


There are important differences between this 
model for null versus preferred directions and that of Ref 
12 (Fig 24). The density of receptors in the retina evolved 
to a very high value for very good reasons, namely 
sensitivity and acuity. More receptors means that many 
receptors can (via bipolar cells) feed a single ganglion 
cell, resulting in very good sensitivity. More receptors 
also means that visual acuity improves, sensitivity being 
contant. The neural circuit of Fig 24, ignoring the dashec 
connections, has the disadvantage of using precious 
receptors for a dedicated purpose. This would degrade 
Sensitivity and acuity, receptor density held constant. The 
model used in this thesis, on the other hand, has all 
receptors synapsing in the "normal" manner, and uses lateral 
inhibiticn among the ganglion cells to derive the null and 
preferred directions. Furthermore, the lateral inhibition 
network could be located extraretinally, such as in the 
lateral geniculate body or the visual cortex, although this 
would not account for the observed directional specificity 


of retinal ganglion cells. 
A more careful consideration of Fig 24 suggests 


that each grcup cf four receptors might provide outputs to 


more than a single cell. This would make more economical use 
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9 ۳ receptors, and could result in a scheme in which 
acuity were not degraded. In fact, if a second set of 
horizontal, bipolar, and ganglion cells were concurrently 
receiving receptor outputs, but with "reverse" organization, 
the opposite preferred direction could be derived. The 
reverse organization is also shown in Fig 24, but smaller 
and connected by dashed lines. This scheme represents a 


consideratle increase in economy over the previous circuit. 


The neural circuit of Fig 24 does have the” 
advantage of an improved nulling in the null direction. The 
reason for this is that the target hyperpolarizes each 
bipolar cell before exciting it. With the model of this 
RNESTS, an Output must occur before inhibition can  cccur. 
Thus the null direction can never have a true null. This 
seems less than tragic when a possible use of such direction 
specific cells is considered. Presumably such cells ccme in 
pairs. That is, for a cell having upward null and downward 
preferred, there should also be a cell having upward 
preferred and downward null directions serving the same 
receptive field. Then, in addition to providing signals to 
the visual associaticn area of the cerebral cortex, these 
neurons might be responsible for proper initiation of a 
reflex such as eye movement for target tracking. Thus, so 
long as the output from the neuron having its preferred 
direction in the actual direction of target motion were 
substantially stronger than the neuron which should be 
nulled, the proper reflex action should result. 
Additionally, because visual processing usually occurs in 
stages, perhaps the nulling could be improved in follow-on 


processing stages. 


Ey sending the output of the null/preferred 
direction network to a target neuron with an oscillatory 
۳ the لل ته‎ ٤۴ is an overall circuit capable of firing 


strongly only when a target ina specific direction at a 
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specific speed is present, as might be found in the pons. 
Such fine grained speed differentiation has not been 
observed retinally, where only high versus low speed 


detectors have been proven to exist. 


ex Fast Pass 


The next model designed was a network of the 
type found in the retina of the rabbit, which would detect 
only fast targets. The lateral inhibition network of Fig 6 
can be used very nicely to detect only fast targets. 
Figures 25 and 27a rget in this network. The heart of the 
high speed pass behavior of this network 1s the fact that 
the inhibition of neighboring neurons is delayed in ramp 
fashion instead of the usual constant delay. This can be 
seen by observing the spread of inhibition in Figure 27a. A 
target which is fast enough is able to excite neuron S to 
produce an output, and then excite neuron T to output 9586 
neuron T is inhibited by neuron S. This network has a very 
abrupt velocity dividing line between detection and no 


detection. 


A slow target illuminating the high pass network 
15 depicted in Figs 26 and 27b. Here, the inhibition 
resulting from the output of neuron S spreads to neurcns T, 
U, V, W, and X in time to inhibit them before the arrival of 
the target illumination. Neuron Y is beyond the influence of 
inhibition by neuron S, and therefore has an output. This 
network could be made more effective, then, by altering the 


LID table such that inhibition would spread farther. 


In Fig 27, note that the ramp delay in spread of 
inhibition ccnsists of  incrementel delays of about ten 
milliseconds. This could be accomplished by several synaptic 
delays [Ref €}. 
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FIGURE 25 = FAST PASS DETECTOR, PART 1 
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ais Slow Pass 


LINHIB can also be used to model a network which 
detects slow targets but fails to detect fast targets. This 
is done by using a constant delay, or perhaps a small ramp 
delay, and by carefully selecting the IPSR duration. The 
plots for such a slow pass network for both slow and fast 
targets are shown in Figs 28, 29, and 30. Pres for the 
slow target, the inhibitory influence on neuron T due to the 
outputs from neuron S are largely gone by the time the 
target illuminates neuron T, and an output results. Only 
neuron Z fails to fire, but it is probable that this neuron 
would fire given several more milliseconds, judging from 
@Semearisoms cf neuron Z's PSP with that of neuron Y. 
Therefore, let us say that all eight neurons fired or would 
have fired. A high speed target is now used to illuminate 
the same network (Fig 29). Note that here, only five of 
eight neurons fired for a speed ratio of twc to one. This 
may seem a rather modest result, but consider that ina 
single pcle filter, a frequency ratio of two to one would 
produce an attenuation of only six decibels, which is 
ccmparable tc the five to eight ratio. A subtle additional 
fact is that a double speed target would produce rcughly 
half the number of inputs per channel to the network. Taking 
"credit" for this result of high speed, the characteristics 
or the network improve somewhat (Fig 30). Here only three 


neurons fire, as ofpos2d to five before. 


>. kegu mization of Random Inputs 


The normal approach to modeling is tc determine vhat 
hard information exists about the system to be modeled, 


build the model, and then use it to determine its usefulness 
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in duplicating the behavior of the real system. Once 
confidence in the model has escalated somewhat, the mcdeler 
can begin to extend application to areas not necessarily 
observed in real life. Then if an interesting output results 
from the model, two possibilities exist. First, the model 
might really not be an adequate description of the real 
system, and the ineresting result worthless. Second, the 
model could be valid, and the resuit could be worth looking 


for in the real system. 


One such result observed while using the lateral 
inhibition network with random inputs 15 that an 
unrandomized output can be produced (Figs 31 and 32). The 
summed output plot, while not completely regular, is 
nonetheless much more regular than any of the inputs. Such 
orderliness results from the very character of the lateral 
inhibition network. Namely, all channels are vying for 
Output production. When an output occurs, all other nearby 
channels are inhibited for the duration of the IPSR. This 
means that during this interval, nearby outputs are 
unlikely. Since this interval would tend to be the same 
after each cutput, the result is a rather uniform tine 
between ۰. ۰ More complete regularization would occur 
if the inhibitory influence were to spread farther. In 
Support of this notion, note that the two closest outputs 
(the third and fourth) in the summed output plot originated 
from spatially distant channels. If inhibitory spread had 
been more complete, then in all likelihood, the fourth 


output would not have occurred so soon. 
This method of regularizing random inputs is to be 
contrasted with that of Fig 17, where an oscillatory PSP was 


needed. 


There are possible uses for an orderly, regularly 


Spaced spike train. In the next section it will be shown 
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FIGURE 29 = SLOW PASS DETECTOR, BRIGHT FAST TARGET 
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FIGURE 30 - SLOW PASS DETECTOR, NORMAL FAST TARGET 
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FIGURE 31 - REGULARIZATION BY LINHIB, PART 1 
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B. OUTPUT 


FIGURE 32 - REGULARIZATION BY LINHIB, PART 2 
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that a régularly spaced set of inputs to an inhibitory 
network has extreme phase sensitivity, so long as the 
channels have roughly equal firing rates. That is, the 
channel ‘whose input phase allows it to produce the first 
output will gain and maintain dominance over the other 
channels. This could be considered as a possible mechanism 
for a perscn being able to direct his attention to only one 


of several sensory inputs of equal level. 


C. SPATIAL FHENOMENA 


INHI 


As a basic example of the operation of LINHIB, 
consider Figs 33 and 34. The inputs are random, but are most 
dense in channel V, decreasing in either direction. It is 
not surprizing that more outputs occur in channel V, since 
more inputs were provided there. But more importantly, the 
ratio of outputs to inputs is highest for channel V, because 
of lateral inhibition. That is, channel V gains dominance 
over the other channels by having outputs which inhibit 
caem. Thus it is more difficult for the other channels to 


prcduce outputs. 


e. obewwtlon and wpisimhibition 


The two most basic spatial phenomena which can be 
dencnstrated using the lateral inhibition network are 
لاد‎ 11110121 and disinhibition (figs 35 and 36). Note that 
Only three of the eight neurons have inputs, and that at 
first, only two have inputs. Neuron X gains dominance over 


Neuron Z by producing an output first. Because 
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FIGURE 33 - BASIC SPATIAL BEHAVIOR OF LINHIB, PART 1 
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C. INHIBITION 
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FIGURE 36 - INHIBITION AND DISINHIBITION, PART 2 
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LID=000234505432000, neuron Z is strongly inhibited and does 
not fire, allowing neuron X to maintain dominance. This 
describes inhibition of neuron Z, and would be analagous to 
a microelectrode measurement of neuron Z while providing a 


bright surround stimulus. 


When neuron U is illuminated with an even brighter 
stimulus than that for neuron X, neuron U gains dominance 
and inhibits neuron X. This results in a complete lack of 
inhibition tc neuron Z, which now fires. (Inhibition from 


neuron U spreads only as far downward as neuron Y). 


Disinhibition has been demonstrated in the limulus 
eye [Ref 6], but is not important to the organism in its own 
A Tt is, rather, a result of the lateral inhibition 
network's characteristics, and served to demonstrate the 


spatial extent of inhibitory spread. 


3. Bright Li 


a. Line Sharpening by Inhibition 


Cne function which a lateral inhibition network 
performs in vision is the Sharpening of lines which 6 
blurred due to scattering in the eyeball's structures. The 
optics of the eye are excellent, but are not perfect. 
Lateral inhibition is a viable method for improving the 
visual system by increasing its resolving power by 


performing sharpening. 


A single, narrow, bright line against a dark 
background was chosen. A lateral inhibition network will 
also perfcrm sharpening on a narrow dark line on a bright 


background, probably just as effectively as the former case. 
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ከከ! Since the 1۲ neuron linear array is tacitly flanked 
by many other neurons in total darkness (no inhibition is 
fed into the networx from above neuron S or below neurcn Z), 


the central kright line was the most reasonakle choice. 


An important point is that line sharpening 
occurs whether or not optical blurring cccurs. In other 
|| 15 it is only the photon distribution on the retinal 
receptors and the exact nature of the neural connections 
which determine the output to the brain. Neither the retina 
nor the brain has any way of Knowing whether a blurred line 
تہ‎ ۳ 1۷۱۰1۵2 On the retina is an optically blurred image of 
an actual sharp line, or a perfect image of an actual 
blurred line. That is, a lateral inhibitory network will 


Sharpen any line, whether it is actually sharp or not: 


Line sharpening is illustrated in Fig 37. For 
this run, the strength of one unit of inhibition was chosen 
to be 1.25 times the strength of one unit of excitation 
(I=1.25E). This was done by controlling the size of the 
IPSR. Note that neuron V has the highest intensity input, 
and is therefore the retinal image of the line's true 
location. But due to scattering, all channels have inputs to 
a lesser extent. The outputs of Fig 37c demonstrate that 
remarkable sharpening has taken place in that oniy neuron V 
has outputs. The reason this happens is that neuron V 
produces the first output and therefore inhibits all other 
neurons fro producing outputs. This and the higher input 


rate allow neuron V to maintain dominance. 


Eecause of the complete nature of this exanple 
or line sharfening, it was decided to lower the IPSR to gain 
some insight into how much inhibition is needed tc give 
satisfactory sharpening. Figure 37b is the resulting output 
for absolutely no inhibition, and does not appear to 


represent any sharpening. A better system for comparing 
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sharpness is needed, however. The pattern can be represented 
by a series of eight numbers with the highest number 
normalized to 100. The other seven numbers would then be 
percentages cf the brightest line. The input distribution is 
then represented 25 SO, 19570773 ال و‎ (zero 
Sharpening) while the output ROB 121. 787 would be 
0 0,100,0,0,0,0 (perfect sharpening). The normalized 
intensity distributions are indicated below each plot. Now 
it can be seen that there is some sharpening even with no 
09 ion at all. This is termed sharpening by threshold, 


DQ will be discussed later. 


The point of this is to note that fairly useful 
sharpening results ali the way down to 1I=0.156E. This 
surprizingiy small amount of inhibition has a marked effect 
because it is actually enhanced by duplication. That is, as 
neurons U, V, and W generate strong outputs, each of them 
contributes to the inhibition of neuron X, thus reducing its 
1۳۲ ۱۱3 250 output count to 13 vice 44 for the no-inhikition 


Case. 


Another question that needs to be raised is that 
of how much sharpening is necessary tc an organism. 
Certainly it cannot benefit from perceiving a world in which 
all contours have been converted into sharp lines. The 
answer to this question is unfortunately not available fron 
these models. But perceptual studies generally do not seen 
to support sharpening as extreme as just demonstrated. Does 
this tend to show that perhaps inhibition, in real-life 
lateral inhikition networks, is low in magnitude relative to 
excitation? The answer is no, since the artificial character 
of the inputs just presented is responsible for the high 
degree of effectiveness of the network. In Fig 37a, the 
fact that all channels have their initial input immediately 
(fixed phase) 15 no coincidence. This was done to 


demonstrate the input style which produces the most striking 


89 





example of line sharpening. Other input styles resulted ina 
lesser degree of sharpening in some cases and in bizarre 
effects in other cases. Specifically, two other input styles 
were investigated: random, and constant frequency with 


random phase. 


The results of line sharpening runs with random 
inputs are shown in Figs 40, 41, and 42. The number of 
inputs to each neuron was carefully chosen to be identical 
to the number for the constant frequency, fixed phase case. 
(This cannot be verified by manually counting markers in Fig 
40a, Since markers sometimes fall so close together so as to 
be unresolvatle graphically. The counts were performed by 
computer and were verified to be identical to those of Fig 
37a.) The striking difference between random inputs and 
constant frequency, fixed phase inputs is tnat much higher 
levels of inhibition are necessary if the random line 
Sharpening is to even approach the latter. The reason is 
obvious: the constant frequency, fixed phase situation had a 
100 percent chance that the correct channel would fire and 
thus inhibit first, and therefore maintain dcminance. With 
random inputs, bunching can occur and force an output even 
in a strongly inhibited channel with low average input 


intensity. 


Examining the normalized output distributions, 
it is clear. that useful sharpening does not occur below 
I=1.25E for this style of random inputs, and the performance 
oí the lateral inhibition network can be called marginal. 
The question arises as to what time sequence best represents 
what the actual inputs to a real-life lateral inhibition 
network might be. Considering that the stimulus is a bright 
line switched on at shortly before time zero, the fixed 
phase input is not totally unreasonable, since all receptors 
would begin to be stimulated at about the same time, and 


would see a steady level of stimulus and hence fire at an 
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unchanging rate. But there is certainly some degree of 
randomness associated with the process of quanta absorption, 
receptor petential generation, and spike production. 
Additionally, saccadic eye movements would cause variations 


in the illumination a particualr receptor would get. 


b. Extreme Phase Sensitivity 


Continuing LO pursue the best input 
representation, consider now a subject staring at a blank 
wall (Figs 43 and 44). If luminance were switched on at just 
before time zero, then randomness in absorption of quanta 
and development of the initial input is represented ky the 
random location of the initial markers (Fig 44a). The fact 
that the subject 15 staring ata large wall of constant 
luminosity accounts for the fact that each channel gets the 
same input intensity. Saccadic eye movements would produce 
no effects in this example. Consider that once the first 
input is created, subsequent inputs are regularly spaced. 
The resulting outputs are bizarre, and demonstrate an 
extreme phase sensitivity. Basically, the first channel to 
generate an output in such a situation will maintain 
dominance in its locality. It is unlikely that this extreme 


phase sensitivity exists in nature. 


C. Line Shift 


If applied to the diffuse line display with 
random phase, this phenomenon can result in a channel with 
lower input intensity gaining and keeping dominance over a 
Channel with higher input intensity (Fig 45). Note that 
Channel Y maintains dominance even though it is lower in 
EN PALE intensity than channels U, V, uw, and X. The 


competition ketween channels U and Y is of interest. Channel 
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1 cho output, but its inhibition of channel Y 
urs during that neuron's refractory period, and is 
therefore ineffective. The inhibition on neuron U by the 
۱۳ output from neuron Y falls after the refractory period 
and is therefore effective. This effect indicates that the 
ከ 7 of spread of inhibition is important in spatial as 


well as temporal phenomena. 


Line shift is undesirable for an animal trying 
۲٣۰۰: 3ط‎ dinner or avoid predators, and has undourtedly 
been eliminated or minimized by randomization of inputs, 
Optimization of spatial extent of inhibitory spread, or 
Both. 


d. Cptimum Stimulus Representation 


The payoff to this lengthy discussion of hcw to 
represent the inputs is the hypothesis that a new genre of 
random inputs needs to be devised. The random inputs of Fig 
40a, generated by an algorithm described in Ref 5, have a 
Poisson distribution and seem to have too much bunching for 
the case of a subject fixing on a static visual field. The 
Poisson input distribution could be modified by a simple 
additional program which would make the input spacing 
somewhat more regular. Such a program would step through tne 
poisson inputs and remove any marker found within a certain 
small time fcllowing any other marker. Additionally, the 
pregram would insert a marker if a longer increment of time 
were to elapse without a marker. The short and long time 


increments wculd be callable parameters. 


e. line Sharpening by Threshold 


There is another conceivable mechanism by which 
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FIGURE 41 - LINE SHARPENING, RANDOM, PART 2 
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FIGURE 43 - ABNORMAL PHASE SENSITIVITY, PART 1 
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line sharpening could occur. By adjusting the threshold for 
spike production, the most intense channel can pe made to 
Rive more often in proportion to its inputs than the less 
intense channels, even in total absence of lateral 
inhibition. Such a mechanism may very well be in operation 
in real crganisns, but it is less effective than the 
powerful lateral inhibition, and also considerably less 
flexible. That is, there are many parameters in lateral 
inhibition which are highly variable in the mcdeling program 
as well as in the organism, and all involve, in one way or 
another, different schemes of neural interconnections. 
Because of the immense number of neurons available, and the 
staggering number of connections a single neuron can make, 
parameters which vary because of differences in neural 
interconnections are realistically capable of wide latitude. 
It is improbable that spike threshold variations would be 


capable of producing such a wide range of effects. 


Threshold sharpening can be discerned in Fig 37. 
Notice that the normalized dust papi’ ton goes fron 
EE 7 /0,100,78,47,31,31 to 19,44,75,100,75,44,19,19 when 
inhibition is removed. This is strictly a threshold effect. 
In Fig 40, however, the 0 21 5 تاه گت‎ 9 goes to 
Pee, 100,835, 38 723,3 700 Which can» hardly be considered 
Sharpened. It appears that the bunching of inputs in the 
randon Input has decreased the effect of threshold 


sharpening. 


4. Spatial Frequency Response 


with cnly eight channels available for inputting 
Spatial distributions, any meaningful verification of the 
modulation transfer function (page 26) is nearly impossible. 
Two effects relating closely to spatial frequency response 


Will, however, be demonstrated. These are, first, the 
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Suppressicn of steady, uniform levels of illumination 
(representing a low spatial frequency) and second, the 
enhancement cf contrast at a border between two regions of 


uniform intensity (Mach bands). 


a. Suppression of Low Spatial Frequencies 


The enormous dynamic range of the visual svsten 
for light intensity is the result of several factors. First, 
there is the fairly minor effect of change in pupillary 
aperture size, which occurs in a time frame of several 
minutes fcllcwing a step change in light intensity. Second, 
there is the major effect of rhodopsin concentration 
changes, which occur over a thirty minute time period. 
Third, there is the logarithmic response of receptor cells. 
Last, there is the effect that an inhibitory neural network 
Should cause an enhancement of dynamic range by virtue of 
its low response to low spatial frequencies [Refs 6 and 17]. 
That is, as few inputs arrive, few outputs occur, and few 
inhibitions result. As more inputs arrive, outputs increase, 
but so do inhibitions, thus holding down the output level. 
AS in regularization by a lateral inhibition network, the 
duration of the IPSR seems to be a key here, since for this 
amount of time, outputs are unlikely. As inputs increase in 
number, they are more likely to meet with a large 


hyperpolarization. 


LINHIB allows quantitative exploration of this 
effect (Figs 46 and 47). With random inputs totaling 3 
(dim light), the inhibitory neural network produces 15 total 
Outputs. If the total number of inputs is increased to 235, 
a factor of 2.83 increase, a total of 41 outputs are 
produced, a factor of 2.73 increase. This result was quite 
disappointing, as the latter number should have been much 


smalier in order to account for any noticeable effect in 
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visual perception. 


while this dynamic range enhancement may appear 
to be only slight (or indeed, guestionable), many factors 
must be considered. First, this effect is very sensitive to 
parameter selection (as are most effects in neural 
modeling). The process of natural selection/evolution over 
Billions of years would probably have produced a more 
effective combination of parameters in the visual system 
than can Le happened upon in the laboratory during modeling. 
Second, with only eight neurons in the array, we are not 
dealing with a true zero spatial frequency, but rather with 
ori gnt band on an occult background. Third, the 68 
model provides for lateral inhibition to occur whenever 
there is an cutput. There is evidence that in limulus, a 
threshold for inhibition exists. That is, 1۶ outputs are at 
a low temporal frequency, no inhibition would occur, but 
above a certain threshold, inhibition would begin to cccur. 
This would cause an increase in the dynamic range by 


increasing the output for dim inputs. 


Thus the attenuation of low spatial frequencies 
by a lateral inhibition network has not been proven by this 
example. To the contrary, the 2.83 fold increase of input 
intensity producing a 2.73 fold increase in outputs casts 
doubt on the suppression of low spatial frequencies at all. 
In fact, even a single EIPSP neuron, when presented with 
successively more intense excitatory inputs, will not 
prcduce outputs which increase by the same ratio (Ref 5). 
This is because as the number of random inputs are 
increased, any of them which occur very shortly following an 
output are "wasted", since inputs occurring during the 
refractory period have no effect on the PSP. Thus the very 
slight observed suppression could have resulted from this 
effect, and not from and characteristics of the lateral 


inhibition network. It became apparent that there are two 
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sides to the EIPSP neuron's output/input ratio story. If the 
number of inputs 1S initially very low (Such as six per 
channel), the ratio will be low, since inputs tend to occur 
alone. As the number increases from this very low value, the 
۱٦00 ۶۹۳ ratio increases as inputs occur closer 
together, temporal summation coming into play. A 4.13 0 
input increase producing a 3.13 fold output increase is now 
seen to be much more impressive, since it represents a large 
amount of hidden suppression in overcoming the temporal 


Summation effect in the neuron output/input characteristic. 


More runs were made to attempt to prove or 
disprove the existence of low spatial frequency attenuation. 
A new pair of input fields was used, this time temporally 
random but Spatially very uniform at six inputs per channel 
for the dil and 31 inputs per channel for the bright field 
(a factor of 4.13). After many hours of parameter variation, 
the best performance attainable was a 3.13 ratio of outputs, 
which is still not overly impressive. It was decided to 
determine what possible offsetting effect due to the EIPSP 
neuron inputycutput characteristic night be present, so the 
same runs were made without inhibition. The result was 
surprising in that a 4.13 fold increase in inputs produced a 
5.94 fold increase in outputs without inhibition. This makes 
the low frequency attenuation of the lateral inhitition 


network more impressive. 


One possible source of poor performance in 
attenuaticn of low spatial frequencies might be that a 
uniform field over an array of only eight neurons is too 
small to be considered a low spatial frequency. In order to 
attempt to eliminate this effect, LID=111111101111111 vas 
used. As will be mentioned in the next section, this LID 
tends to give the efrect of an infinite array. The result 
was disappointing: a 4.13 fold increase in input intensities 


produced a 3.6 fold increase in output intensities, which 
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was not as good as other runs with ramp type LID's. 


This investigation should be continued following 
the develcpment cf the improved random inputs discussed 
earlier. It is also probable that the use of several LINHIB 
processing stages in series could improve the suppression of 


lew spatial frequencies. 


Ferhaps the most impressive quality of the 
retina's lateral inhibition network is that it allows 
Viewing of a large bright region and its low contrast 
details in one area of the visual field simultaneous with a 
large dim region and its low contrast details. The retina, 
With its ability to adjust its overall sensitivity, is the 
09 analogy to a photographic film which has an 
automatically adapting speed. Therefore, because of the 
ability cf the retina to have different sensitivities at 
different regions, a truer analogy would be a photographic 
film which would adjust its sensitivity locally to enhance 


contrast at every point in the field of view [Ref 17]. 


de Mach Bands 


when a bright region borders on a dim one with a 
relatively sharp contour separating the two, the visual 
System's spatial frequency response sharpens the contrast at 
the border. This appears to tne observer as a darkening of 
the dark region near the border, and a lightening of the 
light regicn near the border, the so-called Mach ۰ 
Consider the input field of Fig 48, which represents a 
bright bar on a very dark background. The outputs do not 
have the same distribution as tne inputs, and represent a 
crude Mach band phenomenon. Specifically, the input 
distribution is flat while the Output is 
PER ۱2 7 م9 م9 ۸ ما م9‎ 100. Recalling that the eight neuron 
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array really represents eight neurons receiving some degree 
of illumination while all bordering neurons are in total 
darkness, it is clear that the edges of the distribution 
(neurons S and Z) should appear lighter if the phenomenon is 


to be present. They do indeed appear lighter. 


The LID was chosen as 000000101000000 for this 
demonstraticn in order to enhance the effectiveness. In 
order to understand this, consider why Mach bands appear. 
central neurcns (T, ሀ, V, NW, X, and Y) receive double 
inhibitior  (cnce from each immediate neighbor) whereas edge 
neurons (S and Z) receive only single inhibition (none from 
above S or below Z). By choosing LID=111111101111111 the 
phenomenon can te made to vanish, since each neuron is 
inhibited by each of the other seven (Fig 49). Specifically, 
መጠ ከ የ Output distribution is 83,100,100,100,83,100,83,100, 
which is nearly flat, and certainly shcw no prominent Mach 
bands. For this small network, this LID represents infinite 
spread of inhibition, and tends to model an infinite array 


of neurons (so long as the distribution is uniform). 


Some thought suggests that the most effective 
contour sharpening will result if the dimension of spread of 
inhibiticn is on the same order as the dimension of the 


contour. 


109 


A ENDE 


Ge OUTPUT 
FIGURE 48 - MACH BANDS 


110 





NAA p eS SO 
DR ااا کس ای‎ Aa ما‎ 
2 


یم ی RAR‏ 


AS INPUT 








nó 1 DRE لل‎ ER ګګ‎ os, 

7 

STS SS 2: گا کک سا‎ o S سس‎ 
B. OUTPUT 


FIGURE 49 - ABSENCE OF MACH BANDS 


I3. 





V. CONCLUSIONS 


— = ZW "O E ss => am 


The concept of target neurons which contain PSP's which 
vary from a period of hyperpolarization to a period of 
relative depolarization is hinted at by Refs 2 and 4. This 
concept has teen used in this thesis to model a speed band 
pass gate as well as to regularize a random input spike 
train. The neural oscillator, used to drive the second 
neuron to generate a sinusoidal PSP, is avery simple 
Circuit, and should therefore be sought in living organisms. 
The locaticn of a neural oscillator would probakly be 
central, since this is where the target neurcn for the band 
pass speed detector is located. Both of these models work 
very well, and should be considered as good possibilities as 


to how such phenomena might actually occur in nature. 


The models presented herein for slow and fast speed 
detectors utilize the concept of a lateral inhibitory 
network perfcrming temporal functions rather than the usual 
spatial functions. By varying the IPSR duration, extent of 
inhibitory spread, and delay in spread of inhibition, an 
effective neural speed detection system emerges. The 
location cf such a circuit should be addressed, since in the 
model, ganglion outputs are summed on a geniculate cell, 
whereas in the rabkit, a single ganglion cell is the target 
neuron {Ref 1]. But it is probably also true that the rabbit 
has a later stage of processing wherein a geniculate cell 
serves as a target for speed detection. With this slight 


reservaticn, the model is believable as well as effective. 


The scheme used in this thesis for establishing null 


versus preferred direction in motion detection is less 








desirable than that of Fig 24 since motion in the sull 
direction does not produce a true null. This is probably not 
a serious drawback. One method of improving the null aight 


be to place ancther processing stage in series. 


Desc motion) detection schebe in terms of saving‏ املس 
precious retinal space would be to have the retinal lateral‏ 
network function simply in a spatial role‏ 20۵ ۲ 1 ۱۳۱۱ 
(Sharpening, contrast enhancing, and dynamic range‏ 
increasing). The gaglion cell outputs would then fan out to‏ 
subsequent central lateral inhibition networks where null‏ 
versus preferred direction as well as high pass or low pass‏ 


characteristics would be developed. 


The lengthy discussion of input stimulus representation 
for lateral inhibition networks would apply centrally, but 
would probably not be necessary retinally, where 
predominantly slow potentials occur. With slow potentials, 
the problems of regularity and phase would not occur. But if 
ganglion cell outputs were fed to central lateral inhibition 


networks, such considerations would apply. 


Although handicapped by the basic difference in form of 
input stimulus, the LINHIB program did a good job in 
exploring the effects of line Sharpening, inhibition and 
Peston bition, and Mach band formation. It must be 
emphasized, however, that LINHIB models a central lateral 
inhibition network, whereas most of these spatial phenomena 
prcbably occur retinally. The modeling of spatial phenomena 
should, therefore, be taken less seriously than tne modeling 


of temporal fhencmena. 


The perfcrmance of LINHIB in suppressing low spatial 
frequencies was not as dramatic as expected until 
performance without inhibition was explored. Then, it became 


Obvious that much of the low spatial frequency suppression 
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was being masked by a change in the basic EIPSP neuron's 
output/input ratio as input density increases. To 57 
the point, the same change in output/input ratio would in 
all probability not occur with slow potential interaction, 
and the low spatial frequency suppression would be more 
marked. This represents additional evidence that low spatial 


frequencies are suppressed retinally. 
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Many physiological systems are ripe for computer 
modeling. One example is the muscle stretch receptor unit. 
Comments here, however, will be confined to expanding and 
refining the modeling of visual neurophysiology, and the 


neuron in general. 


At present, all modeling assumes that information fasses 
from neurcn to neuron via the chemical synapse, and that all 
information is in the form of action potentials or spikes. 
There is a growing body of evidence that cther forms of 
inter-neuronal communications exist. ae 15 a long 
established fact that sensory receptors do not generate 
Spikes, but rather maintain a greater or lesser membrane 
potential in response to external stimuli. 3 
horizontal and bipolar cells in the retina do not generally 
exhibit spike activity, but communicate with other neurons 
by some other means. Recent evidence indicates that the 
varying memtrane potential in these cases modulates the 
release cf neurotransmitter at chemical synapses [Ref 15]. 
Although this neurotransmitter has not yet been specified 
for retinal neurons and receptors, the synaptic vessicles 
can clearly ke seen in electron micrographs. It appears to 
be a valid general principle that spikes are not necessary 
For 11۳ ۰۲ - ۱۱6۱1۲ 0183 ال‎ communication, but rather tnat their 
purpose is to allow a summed signal at the axon hillcck to 
be communicated intra-neuronally to the presynaptic bulbs 
via a lengthy axon. Electrotonic spread would be inadequate 
because of the losses which would occur over the length of 
the axon. In order to be as factual as possible, then, the 


modeler should undertake this Sort of inter-neuronal 
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communicaticn. 


The fact that loss is inherent in electrotonic spread of 
the PSR raises an interesting issue. Namely, how much 
membrane potential change at the synapse is necessary to 
cause modulation of neurotransmitter release? With spike 
action potentials, arrival is accompanied by the release of 
one ከ. OE neurotransmitter. with slow potentials, 
however, the length of the axon-like process would affect 
the change in potential at the synapse, and therefore would 
also affect the degree of modulation of neurotransmitter 
release. It is not entirely reasonaole that process length 
should be so important, but it would serve as a mechanisa 
whereby the strength of inhibition would decrease with 
distance from the neuron initiating the inhibition. Perhaps 
there is some threshold for nembrane potential change, and 
so long as the change were greater than threshold, a "unit" 
STE 0۱2 131 2 ۵6 would occur. It is doubtful that this point 
could be clarified by the type of modeling described in this 


thesis. 


In aGditicn to non-spike inter-neuronal communication at 
chemical synapses, it has been maintained for many years 
that electrical synapses exist. The major evidence seems to 
be twofold. First, specialized regions at which memkranes 
Some into ultra close proximity (on the order of 20 
angstroms) have been observed, and are believed to be 
electrical synapses. Second, microelectrode studies in many 
instances have produced neuron pairs whose PSP's vary nearly 
synchronously, but not identically, jRer 14] in response to 
induced semkrane currents in only one of the neurons. The 
principle drawback to quick acceptance of this scheme is 
that the mechanism of coupling has not been elucidated. Ifa 
current at the electrical synapse is responsible for the 
change in membrane potential of the postsynaptic neuron, 


then the unquestioned existence of membrane capacitance 
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(which would reguire an integration time in order for 
synaptic current to produce a postsynaptic voltage change) 
would make simultaneous variation of membrane potentials 
impossible. If current at such a specialized site causes 
some postsynaptic membrane permeability change which would 
then spread, causing a rapid change in PSP, this would be a 
more plausable explanation. No such mechanism has been 
found, however. Because electrotonic coupling seems to be 
here to stay, the modeler should include it in his 


repertoire. 


One improvement in the present way the PSP is computed 
might be in order. Currently, a large number of closely 
Spaced I-inputs will drive the PSP negative until the 
largest negative integer capable of being represented Ly one 
computer word is reached. In a real neuron, nowever, there 
is a limit to the amount of hyperpolarization which can 
occur. It is the ion concentrations, both inside and outside 
the neuron, as well as tne membrane's permeability for each 
ion which, when plugged into the Nernst equation [Ref 9], 
give nemrrane potential. Excitatory as well as inhibitory 
inputs alter membrane potential by altering the membrane's 
permeability for sodium and/or potassium ions. Thus, there 
is a limit to the amount of hyperpolarization which can 


occur; this limit should be incorporated into the models. 


There is one improvement which could be made in the 
fatigue/facilitation program (PSPFAT). At present, the 
running average is calculated for each word of the 1K 
processing block. That number is then used to adjust the 
magnitude of the PSR for all inputs since the end cf the 
last refractcry period. Thus, the shape of the PSR for a 
given input would vary from the accepted shape because of 
its being weighted differently at different processing 
words. A more realistic method, but one which involves more 


processing, would be to assign a weight to the PSR of a 


given input at the time the input occurs. Then, whenever 
that particular PSR were summed to form a PSP word, the 
original weight would be used. This could be handled by 
using the high bytes of the words of the age factor stack as 
the weight. This method would be more consistent with the 
mechanism of fatigue in which the amount of neurotransmitter 


released changes. 


As mentioned in the section on motion detection, the 
null versus preferred detector using LINHIB differs from 
that propcsed by Ref 12 and pictured in Fig 24. This neural 


circuit would be very worthwhile to model. 


Discussed in the section on oscillatory PSP's was the 
problem of phase in a speed band pass gate. The thought that 
perhaps the oscillator neuron is strobed by a moving target 
of any speed such that the proper phase is produced in the 
oscillatory FSP is an intriguing one well worth an attempt 


at modeling. 


The mcving target models using LINHIB all have one 
difficulty which should eventually be corrected. For a 
mcving target, the models work satisfactorily. But consider 
the response to a bright stimulus which simultaneously 
illuminates all eight neurons. All would have outputs, and 
the speed gate target neuron would have a false sense of a 
moving target at the pass speed. The solution to this is to 
introduce fatigue into each of the eight neurons. In this 
za, Signiflcant firing would occur in all eight only 


initially, and the target neuron would have output only at 


first. 
Another inprovement to LINHIB would involve the 
directionality of the ramp delay. At present, either 


constant delay in both directions or ramp delay in both 


directions is selectable. If one could select constant delay 





in one direction and ramp delay in the other, then a neuron 
with null and preferred directions which could have high 
speed pass properties in the preferred direction could be 
modeled. Similarly, if different PSR durations could be 
specified for different directions in LINHIB, then a network 
which could have a null direction, and detect only slow 


targets in the preferred direction could be modeled. 


With only eight channels available in LINHIB, the 
investigaticn of spatial phenomena is severely restricted. 
Any meaningful evaluation of the spatial frequency response 
of such a network would require far more than eight channels 
of resolution. If 100 channels were available, one could 
provide inputs which had Various spatial frequency 
characteristics (such as a Sinusoidal or square wave 
grating), and derive the outputs. The spectra for input and 
output could ther be found by Fourier transform of a block 
of 100 words where each word represents the count ina 
channel, thus providing a transfer function in the freguency 
domain. The parameters to be varied would involve the 
distance cf inhibitory spread and the spatial shape of the 
fall-off., Using the general philosophy of LINHIE, but 
requiring enlargement, rearrangement, and reorganization, 
one could expand the number of channels to a very large 
number. This would involve shortening the block length, 
perhaps, but would also require the technique of processing 
ail blæk: for several words, storing results on disk, 
processing the next several words for all blocks, and so on 
until ccmplete. Plotting would then require recall of blocks 
from 七 he disk. This modeling project would te an 


undertaking of major proportions. 


Neural circuits which recognize static patterns exist 
and should be fairly easy to model. Examples of static 
patterns which have been observed to produce strong outputs 


frcm cortical target cells are borders between light and 
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dark regions and light or dark slits or narrow bars on 
contrasting backgrounds. Pattern orientation is of extreme 


importance in these examples [Ref 10]. 


The importance of pattern recognition ٥ living 
organisms cannot be overstated. It is amazing that a person 
can recognize a dinner plate even though it is tilted such 
that it appears elliptical. Even more amazing is the fact 
that an ovai serving platter also appears elliptical when 
511250 but this would seldom be confused with the 
elliptical shape of the dinner plate. It is true that this 
sort of recognition would require far more complicated 
neural 5128631127 than recognition of a slit or  bcrder. 
Nonetheless, the principles are probably the same. The 
target neurons of cortical area 17 (the primary visual area) 
identify small simple patterns. The columnar organizaticn of 
area 17 allows cortical area 18 (the secondary visual area) 
to piece together long lines, bars, borders, and shapes from 
Shert patterns. Cortical area 19 (the visual association 
area) performs the tasks of putting long lines and shapes 
together intc an overall perception, and of bringing the 
individual's past visual experiences into comparison with 
the current scene. This is a giant step representing a 
massive amount of processing, but in all likelihood, many 


repetitions of a few simple circuits are responsible fcr it. 


The modeling of pattern recognition circuits is a large 
area, and a very interesting one, as it relates so closely 
to one's most valuable sense. Creativity in devising and 
modeling neural circuits capable of recognizing patterns 
could aid in understanding the neural circuits which perform 
pattern recognition in real visual systems. The modeling of 
Pattern recognition circuits is certainly one of the most 


worthwhile areas for future modeling. 
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